Maximum Density Divergence for Domain Adaptation
نویسندگان
چکیده
Unsupervised domain adaptation addresses the problem of transferring knowledge from a well-labeled source to an unlabeled target where two domains have distinctive data distributions. Thus, essence is mitigate distribution divergence between domains. The state-of-the-art methods practice this very idea by either conducting adversarial training or minimizing metric which defines gaps. In paper, we propose new method named Adversarial Tight Match (ATM) enjoys benefits both and learning. Specifically, at first, novel distance loss, Maximum Density Divergence (MDD), quantify divergence. MDD minimizes inter-domain ("match" in ATM) maximizes intra-class density ("tight" ATM). Then, address equilibrium challenge issue adaptation, consider leveraging proposed into framework. At last, tailor as practical learning loss report our ATM. Both empirical evaluation theoretical analysis are reported verify effectiveness method. experimental results on four benchmarks, classical large-scale, show that able achieve performance most evaluations. Codes datasets used paper available {\it github.com/lijin118/ATM}.
منابع مشابه
Sample-oriented Domain Adaptation for Image Classification
Image processing is a method to perform some operations on an image, in order to get an enhanced image or to extract some useful information from it. The conventional image processing algorithms cannot perform well in scenarios where the training images (source domain) that are used to learn the model have a different distribution with test images (target domain). Also, many real world applicat...
متن کاملMaximum Classifier Discrepancy for Unsupervised Domain Adaptation
In this work, we present a method for unsupervised domain adaptation (UDA), where we aim to transfer knowledge from a label-rich domain (i.e., a source domain) to an unlabeled domain (i.e., a target domain). Many adversarial learning methods have been proposed for this task. These methods train domain classifier networks (i.e., a discriminator) to discriminate distinguish the features as either...
متن کاملDomain Adaptation of Maximum Entropy Language Models
We investigate a recently proposed Bayesian adaptation method for building style-adapted maximum entropy language models for speech recognition, given a large corpus of written language data and a small corpus of speech transcripts. Experiments show that the method consistently outperforms linear interpolation which is typically used in such cases.
متن کاملA Bayesian Divergence Prior for Classiffier Adaptation
OMB requires that influential scientific information on which a Federal Agency relies in a rule-making proceeding be subject to peer review to enhance the quality and credibility of the government’s scientific information. These studies constitute influential scientific information under OMB’s definition, 1 and thus these studies must be subject to peer review. OMB further requires Federal Agen...
متن کاملDeep Unsupervised Domain Adaptation for Image Classification via Low Rank Representation Learning
Domain adaptation is a powerful technique given a wide amount of labeled data from similar attributes in different domains. In real-world applications, there is a huge number of data but almost more of them are unlabeled. It is effective in image classification where it is expensive and time-consuming to obtain adequate label data. We propose a novel method named DALRRL, which consists of deep ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2021
ISSN: ['1939-3539', '2160-9292', '0162-8828']
DOI: https://doi.org/10.1109/tpami.2020.2991050